Show code
pacman::p_load(tidyverse, kableExtra, knitr, highcharter, scales,
ggthemes, RColorBrewer, lubridate, wordcloud, tidytext,
ggforce, ggraph, igraph, visNetwork, tm, plotly)Decoding Chaos: Initial Data Exploratory Analysis (IDEA)
Teo Suan Ern
February 27, 2024
March 2, 2024
Take-home exercise 4 is the preliminary work of the final group project - Decoding Chaos. Armed conflicts due to political violence and coordinated attacks targeting innocent civilians, have been on the rise globally. This threatens the public at both physical and psychological levels. A good visual analysis of armed conflicts is essential to help (1) discover armed conflicts trends and (2) conceptualise armed conflict spaces.
The project team consists of three members, and each member will take one of the main prototype modules as follows:
Exploratory Data Analysis (Initial & Geospatial)
Spatial Point Pattern Analysis
Multivariate Clustering Analysis
The project will be using open-source data from armed conflict events (Armed Conflict Location & Event Data Project (ACLED)). The objective of my assignment is to build a prototype - user interface (UI) design on Exploratory Data Analysis (Initial & Geospatial) that provides easy-to-use and insightful visualisation tools that can be suitable for Defence and Security sectors to develop effective counter measures and strategies.
This assignment is separated into three segments (web pages):
The project uses p_load() of pacman package to check if the R packages are installed in the computer.
The following code chunk is used to install and launch the R packages.
tidyverse: a family of modern R packages specially designed to support data science, analysis and communication task including creating static statistical graphs.
knitr: an report generation tool.
ggthemes: an R package that provides extra themes, geoms and scales to ggplot2 package.
DT: an R interface to the JavaScript library DataTables that create interactive table on html page.
plotly: an R package for creating interactive charts.
scales: an scale package used for controlling axis and legend labels.
lubridate: an R package that facilitates to use of dates and time elements.
wordcloud: a text mining package and word cloud generator.
tidytext: an R package that provides functions and supports seamless conversions of text to and from tidy formats of datasets.
tm: an R package that provides text mining applications.
ggforce: an extension of ggplot2 to provide visual data analysis with newer stats and geoms.
ggraph: build network graph visualisation using appropriate functions
igraph: an interface for analysis of graphs or networks.
visNetwork: an R package for interactive network visualisation.
highcharter: a wrapper that contains ‘highcharts’ library for plotting of R objects.
The project will examine the dataset from Armed Conflict Location & Event Data Project (ACLED), specifically Myanmar country, between Year 2010 and Year 2023.
The combined data consists of 55,574 observations and 35 variables. Each row details the armed conflict event on the type, agents, location, date and other characteristics of conflict events (such as political violence, demonstration) in Myanmar.
str() to check the structure of the data.'data.frame': 55574 obs. of 35 variables:
$ event_id_cnty : chr "MMR56099" "MMR56222" "MMR56370" "MMR56376" ...
$ event_date : chr "31-Dec-23" "31-Dec-23" "31-Dec-23" "31-Dec-23" ...
$ year : int 2023 2023 2023 2023 2023 2023 2023 2023 2023 2023 ...
$ time_precision : int 1 1 1 1 1 1 1 1 1 1 ...
$ disorder_type : chr "Political violence" "Political violence" "Political violence" "Demonstrations" ...
$ event_type : chr "Explosions/Remote violence" "Explosions/Remote violence" "Battles" "Protests" ...
$ sub_event_type : chr "Shelling/artillery/missile attack" "Shelling/artillery/missile attack" "Armed clash" "Peaceful protest" ...
$ actor1 : chr "Military Forces of Myanmar (2021-)" "Military Forces of Myanmar (2021-)" "Phoenix DF: Phoenix Defense Force (Nattalin)" "Protesters (Myanmar)" ...
$ assoc_actor_1 : chr "" "" "" "" ...
$ inter1 : int 1 1 3 6 1 1 3 1 2 1 ...
$ actor2 : chr "" "Civilians (Myanmar)" "Military Forces of Myanmar (2021-)" "" ...
$ assoc_actor_2 : chr "" "" "" "" ...
$ inter2 : int 0 7 1 0 7 0 1 0 1 7 ...
$ interaction : int 10 17 13 60 17 10 13 10 12 17 ...
$ civilian_targeting: chr "" "Civilian targeting" "" "" ...
$ iso : int 104 104 104 104 104 104 104 104 104 104 ...
$ region : chr "Southeast Asia" "Southeast Asia" "Southeast Asia" "Southeast Asia" ...
$ country : chr "Myanmar" "Myanmar" "Myanmar" "Myanmar" ...
$ admin1 : chr "Mon" "Rakhine" "Bago-West" "Sagaing" ...
$ admin2 : chr "Mawlamyine" "Maungdaw" "Thayarwady" "Yinmarbin" ...
$ admin3 : chr "Ye" "Maungdaw" "Nattalin" "Salingyi" ...
$ location : chr "Aing Shey" "Kaing Gyi (NaTaLa)" "Kyauk Pyoke" "Let Pa Taung" ...
$ latitude : num 15.3 20.7 18.6 22.1 18.6 ...
$ longitude : num 98 92.4 95.8 95.1 95.8 ...
$ geo_precision : int 1 2 2 2 1 1 1 2 2 1 ...
$ source : chr "Democratic Voice of Burma" "Development Media Group; Narinjara News" "Khit Thit Media; Myanmar Pressphoto Agency" "Myanmar Labour News" ...
$ source_scale : chr "National" "Subnational" "National" "National" ...
$ notes : chr "On 31 December 2023, in Aing Shey village (Ye township, Mawlamyine district, Mon state), following a clash betw"| __truncated__ "On 31 December 2023, in Kaing Gyi (Mro) village (coded as Kaing Gyi (NaTaLa)) (Maungdaw township, Maungdaw dist"| __truncated__ "On 31 December 2023, near Kyauk Pyoke village (Nattalin township, Thayarwady district, Bago-West region), the P"| __truncated__ "On 31 December 2023, in the Let Pa Taung area of Salingyi township (Yinmarbin district, Sagaing region), protes"| __truncated__ ...
$ fatalities : int 0 0 4 0 0 0 3 0 0 0 ...
$ tags : chr "" "" "" "crowd size=no report" ...
$ timestamp : int 1704831212 1704831213 1704831214 1704831214 1704831214 1704831216 1704831216 1704831216 1704831216 1704831216 ...
$ population_1km : int NA NA NA 749 NA 178 6634 671 687 35292 ...
$ population_2km : int NA NA NA 521 NA 135 19078 2197 654 85732 ...
$ population_5km : int 3081 NA NA 1358 NA NA 34396 3144 656 169473 ...
$ population_best : int 3081 NA NA 749 NA NA 34396 3144 656 85732 ...
The output above reveals that event_date is in character format instead of date format.
colSums to check for missing valuesThe output below shows that there are three variables with missing values.
duplicate() to check for duplicates:There is no duplicate entries in the dataset.
[1] event_id_cnty event_date year time_precision
[5] disorder_type event_type sub_event_type actor1
[9] assoc_actor_1 inter1 actor2 assoc_actor_2
[13] inter2 interaction civilian_targeting iso
[17] region country admin1 admin2
[21] admin3 location latitude longitude
[25] geo_precision source source_scale notes
[29] fatalities tags timestamp population_1km
[33] population_2km population_5km population_best
<0 rows> (or 0-length row.names)
The flowchart diagram below provides an overview of the key variables used in this project.
flowchart TD A(Key Variables Used \n event_id_cnty) A --> B(Time Period) A --> C(Characteristic of Incident) A --> D(Location) B --> E(year) B --> F(date) B -.-> G(New Variables) G -.-> H(day) G -.-> I(week number) G -.-> J(month) C --> K(event_type) C --> L(sub_event_type) C --> M(actor1) C --> N(actor2) C --> O(fatalities) C -.-> P(New Variables) P -.-> Q(total incidents) P -.-> R(total fatalities) P -.-> S(political violence rate) P -.-> T(violence against civilian rate) P -.-> U(territory exchange rate \n-non-state exchange) P -.-> V(territory exchange rate \n-government regains territory) D --> W(country) D --> X(longitude) D --> Y(latitude) D --> Z(admin1) D --> AA(admin2) D --> AB(admin3) D -.-> AC(New Variables) AC -.-> AD(geometry points) AC -.-> AE(shapeID)
The code chunk below uses dmy() convert to date format from character to date format:
The code chunk below creates the following new variables based on total armed conflict incidents and total fatalities (by disorder_type and sub_event_type):
Annual percentage of political violence
Annual percentage of violence against civilian
Annual percentage of government regains territory
Annual percentage of non-state actor overtakes territory
data2 <- data %>%
filter(fatalities > 0) %>%
group_by(year) %>%
mutate(
total_fata = sum(fatalities),
total_inci = n(),
## incidents
# Political violence rates
political_rate = round(
sum(total_inci[event_type %in% c("Battles", "Protests", "Explosions/Remote violence", "Violence against civilians")]) /
sum(total_inci) * 100),
# Violence against civilian rates
civilian_rate = round(
sum(total_inci[event_type == "Violence against civilians"]) /
sum(total_inci) * 100),
# Exchange of territory
non_state_exchange = round(
sum(total_inci[sub_event_type == "Non-state actor overtakes territory"]) /
sum(total_inci) * 100),
govt_regain_exchange = round(
sum(total_inci[sub_event_type == "Government regains territory"]) /
sum(total_inci) * 100),
## fatalities
# Political violence rates
political_rate = round(
sum(total_fata[event_type %in% c("Battles", "Protests",
"Explosions/Remote violence",
"Violence against civilians")]) /
sum(total_fata) * 100, 2),
# Violence against civilian rates
civilian_rate = round(
sum(total_fata[event_type == "Violence against civilians"]) /
sum(total_fata) * 100, 2),
# Exchange of territory
non_state_exchange = round(
sum(total_fata[sub_event_type == "Non-state actor overtakes territory"]) /
sum(total_fata) * 100, 2),
govt_regain_exchange = round(
sum(total_fata[sub_event_type == "Government regains territory"]) /
sum(total_inci) * 100, 2)
) %>%
ungroup()The code chunk below selects/ excludes the variables intended to be used for this project.
The code chunk below save dataset in .rds format for subsequent geospatial EDA.
Use str() to check the structure of the final dataset.
tibble [13,177 × 32] (S3: tbl_df/tbl/data.frame)
$ event_id_cnty : chr [1:13177] "MMR56370" "MMR56871" "MMR56878" "MMR56900" ...
$ event_date : Date[1:13177], format: "2023-12-31" "2023-12-31" ...
$ year : int [1:13177] 2023 2023 2023 2023 2023 2023 2023 2023 2023 2023 ...
$ disorder_type : chr [1:13177] "Political violence" "Political violence" "Political violence" "Political violence" ...
$ event_type : chr [1:13177] "Battles" "Battles" "Explosions/Remote violence" "Battles" ...
$ sub_event_type : chr [1:13177] "Armed clash" "Armed clash" "Air/drone strike" "Armed clash" ...
$ actor1 : chr [1:13177] "Phoenix DF: Phoenix Defense Force (Nattalin)" "MSRF: Mon State Revolutionary" "Military Forces of Myanmar (2021-)" "MSPDF: Myaung Special People's Defense Force" ...
$ assoc_actor_1 : chr [1:13177] "" "Daw Na Column; YGF: Ye Guerrilla Force; ABSDF: All Burma Students' Democratic Front; MSRU: Mon State Revolution"| __truncated__ "" "NRDF: Natogyi Regional Defense Force; People's Defense Force - Meiktila District; People's Defense Force - Mony"| __truncated__ ...
$ inter1 : int [1:13177] 3 3 1 3 3 1 3 1 2 3 ...
$ actor2 : chr [1:13177] "Military Forces of Myanmar (2021-)" "Military Forces of Myanmar (2021-)" "Civilians (Myanmar)" "Military Forces of Myanmar (2021-)" ...
$ assoc_actor_2 : chr [1:13177] "" "" "" "Police Forces of Myanmar (2021-)" ...
$ inter2 : int [1:13177] 1 1 7 1 1 7 1 7 1 1 ...
$ interaction : int [1:13177] 13 13 17 13 13 17 13 17 12 13 ...
$ civilian_targeting : chr [1:13177] "" "" "Civilian targeting" "" ...
$ iso : int [1:13177] 104 104 104 104 104 104 104 104 104 104 ...
$ region : chr [1:13177] "Southeast Asia" "Southeast Asia" "Southeast Asia" "Southeast Asia" ...
$ country : chr [1:13177] "Myanmar" "Myanmar" "Myanmar" "Myanmar" ...
$ admin1 : chr [1:13177] "Bago-West" "Mon" "Sagaing" "Sagaing" ...
$ admin2 : chr [1:13177] "Thayarwady" "Mawlamyine" "Katha" "Monywa" ...
$ admin3 : chr [1:13177] "Nattalin" "Ye" "Tigyaing" "Chaung-U" ...
$ location : chr [1:13177] "Kyauk Pyoke" "Kyaung Ywar" "Kan Pauk" "Chaung-U" ...
$ latitude : num [1:13177] 18.6 15.3 23.9 22 21.3 ...
$ longitude : num [1:13177] 95.8 98 96.1 95.3 95.4 ...
$ source : chr [1:13177] "Khit Thit Media; Myanmar Pressphoto Agency" "Democratic Voice of Burma; Khit Thit Media; Myanmar Pressphoto Agency" "Democratic Voice of Burma; Khit Thit Media; Myanmar Pressphoto Agency; Radio Free Asia" "Khit Thit Media; Myanmar Pressphoto Agency" ...
$ notes : chr [1:13177] "On 31 December 2023, near Kyauk Pyoke village (Nattalin township, Thayarwady district, Bago-West region), the P"| __truncated__ "On 31 December 2023, in Kyaung Ywar village (Ye township, Mawlamyine district, Mon state), a combined force of "| __truncated__ "On 31 December 2023, in Kan Pauk village (Tigyaing township, Katha district, Sagaing region), the Myanmar milit"| __truncated__ "On 31 December 2023, in Chaung-U town (Chaung-U township, Monywa district, Sagaing region), a combined force of"| __truncated__ ...
$ fatalities : int [1:13177] 4 3 1 1 2 1 3 1 1 4 ...
$ total_fata : int [1:13177] 15716 15716 15716 15716 15716 15716 15716 15716 15716 15716 ...
$ total_inci : int [1:13177] 4054 4054 4054 4054 4054 4054 4054 4054 4054 4054 ...
$ political_rate : num [1:13177] 99.5 99.5 99.5 99.5 99.5 ...
$ civilian_rate : num [1:13177] 23.3 23.3 23.3 23.3 23.3 ...
$ non_state_exchange : num [1:13177] 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.02 ...
$ govt_regain_exchange: num [1:13177] 0 0 0 0 0 0 0 0 0 0 ...
Before proceeding with data visualisation, it is essential to be able to navigate the dataset of 13,177 observations and 30 variables with ease. This segment will help users identify or navigate through the dataset observations instead of scrolling through each observation one-by-one. The interactive datatable is created using DT package.
Display number of observations by selecting the dropdown (5, 10, 25, 50, 100 entries). This ensure that the observations will not span across the entire webpage.
View other pages of observations with “previous” or “next” button.
Search specific observations with the search bar for the occurrence of a string/ numerical value in any column of an observation
Filter observations with the filter bar directly below column headers.
Column visibility allows user to select the columns that they are interested to view and hide the rest
DT::datatable(
final,
class = "compact",
filter = "top",
extensions = c("Buttons"),
options = list(
pageLength = 5,
columnDefs = list(
list(targets = c(1:23, 26:32), className = "dt-center"), # text align center
list(targets = c(24, 25), visible = FALSE)
),
buttons = list(
list(extend = "colvis", columns = c(1:30))
),
dom = "Bpiltf"
),
caption = "Table 1:"
)